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Abstract 

In this paper, we consider the problem of computing the smallest enclosing ball (SEB) of a 
set of m balls in M", where the product mn is large. We first approximate the non-differentiable 
SEB problem by its log-exponential aggregation function and then propose a computationally 
efficient inexact Newton-CG algorithm for the smoothing approximation problem by exploiting 
its special (approximate) sparsity structure. The key difference between the proposed inexact 
Newton-CG algorithm and the classical Newton-CG algorithm is that the gradient and the 
Hessian-vector product are inexactly computed in the proposed algorithm, which makes it capa¬ 
ble of solving the large-scale SEB problem. We give an adaptive criterion of inexactly computing 
the gradient/Hessian and establish global convergence of the proposed algorithm. We illustrate 
the efficiency of the proposed algorithm by using the classical Newton-CG algorithm as well as 
the algorithm from [Zhou, et al. in Comput. Opt. & Appl. 30, 147-160 (2005)] as benchmarks. 

Keywords: Smallest enclosing ball, smoothing approximation, inexact gradient, inexact Newton- 
CG algorithm, global convergence. 


1 Introduction 

The smallest enclosing ball (SEB) problem is considered in this paper. The SEB problem is to find 
a ball with the smallest radius that can enclose the union of all given balls Bi (i = 1,2, •• • , m) 
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with center Cj and radius > 0 in M"', i.e. 


Bi = {x £ M”" I \\x — Ci\\ < ri} . 


Define 


where 


f{x) = max {fi{x)} , 
l<2<m 


fi{x) = ||x-Cj|| +rj, i = 1,2, 


Then, the SEB problem can be formulated as the following nonsmooth convex optimization problem 

n: 

mm /(I). (1) 

It is shown in [1] that problem Q has a unique solution. 

The SEB problem arises in a large number of important applications, often requiring that it should 
be solved in large dimensions, such as location analysis [2], gap tolerant classifiers in machine 
learning 13 ISIS], tuning support vector machine parameters [6], support vector clustering di, 
/c-center clustering [9j, testing of radius clustering m, pattern recognition lain!, and it is itself 
of interest as a problem in computational geometry naiiaiiaiiaiiniE]- 

Many algorithms have been proposed for the special case of problem Q with all r* degenerating 
into zero, i.e., the problem of the smallest enclosing ball of points. To the best of our knowledge, if 
the points lie in low n-dimensional space, methods m [IS [201 EH ESI from computational geometry 
community can yield quite satisfactory solutions in both theory and practice. Nevertheless, these 
approaches cannot handle most of very recent applications in connection with machine learning 
laisi and support vector machines [Hi that require the problem of higher dimensions to be 
solved. 


Obviously, the non-differentiable convex SEB problem 0 can be solved directly by the subgra¬ 
dient method [23l El]' With an appropriate step size rule, the subgradient method is globally 
convergent. However, the subgradient method suffers a quite slow convergence rate, and it is 
very sensitive to the choice of the initial step size. By introducing additional slack variables 
r G M, {sj G , {ti G K}™ i, the SEB problem 0 can be equivalently reformulated as a second 

order cone program (SOCP) as follows: 


min r 

s.t. r -ti = n, 

X Si — Ci^ 
11 11 — ^2 • 
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As shown in [T], while the above SOCP reformulation of the SEB problem can be efficiently solved 
by using the standard software package like SDPT3 |25j with special structures taking into account, 
it typically requires too much memory space to store intermediate data, which makes the approach 
prohibitively being used for solving the SEB problem with large dimensions. 

Recently, various smooth approximation-based methods [Il[26l[2Zl[28l[29l[3ni[3ll[32l[33l[3l] have 
been proposed for solving the SEB problem in high dimensions. Eor instance, the log-exponential 
aggregation function |35t |36] was used in [T] to smooth the maximum function, and then the limited- 
memory BEGS algorithm m was presented to solve the resulting smoothing problem. In m, 
the authors used the Chen-Harker-Kanzow-Smale (CHKS) function [38l |39l HQ] to approximate the 
maximum function, and again, applied the limited-memory BEGS algorithm to solve the smoothing 
approximation problem. 

The goal of this paper is to develop a computationally efficient algorithm that could be used to solve 
the SEB problems with large mn. Different from the existing literatures p in Eg [Ml Eg Ea ED], 
our emphasis is not to develop new smoothing techniques but to design efficient algorithms for 
solving the existing smoothing approximation problems by using their special structures. 

The main contribution of this paper is as follows. We propose a computationally efficient inex¬ 
act Newton-GG algorithm that can efficiently solve the SEB problems with large mn. At each 
iteration, the proposed algorithm first applies the GG method to approximately solve the inexact 
Newton equation and obtain the search direction; and then a line search is performed along the ob¬ 
tained direction. The distinctive advantage of the proposed inexact Newton-CG algorithm over the 
classical Newton-GG algorithm is that the gradient and the Hessian-vector product are inexactly 
computed, which makes it more suitable to be used to solve the SEB problem of large dimensions. 
Under an appropriate choice of parameters, we establish global convergence of the proposed inexact 
Newton-CG algorithm. Numerical simulations show that the proposed algorithm takes substan¬ 
tially less CPU time to solve the SEB problems than the classical Newton-CG algorithm and the 
state-of-the-art algorithm in [T]. 

The rest of the paper is organized as follows. In section we briefly review the log-exponential 
aggregation function. In section by taking into the special structure of the log-exponential ag¬ 
gregation function into consideration, the inexact Newton-CG algorithm is proposed for solving 
the SEB problem. Global convergence of the proposed algorithm is established in Section Nu¬ 
merical results are reported in Section to illustrate the efficiency of the proposed algorithm, and 
conclusion is drawn in section 
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2 Review of Log-Exponential Aggregation Function 


For any /U > 0, the smooth log-exponential aggregation function of f{x) in Q is defined as 


f{x;n) = /rln ^ exp (/j(x;//)//r) , 


( 2 ) 


V 2=1 


where 

fi{x-, fi) = s/Wx - CiP -h /i^ -h Tj, i = 1, 2,..., m. 


Lemma 2.1 t [Tl [26l 1351136] 1 The function f{x; in (© has the following properties: 


(i) For any x and 0 < fii < fi 2 , we have f{x; /ii) < f{x] 

(a) For any x gW^ and p, > 0, we have f{x) < /(x; p) < f{x) + p{l + \n.m) ■, 

(Hi) For any /r > 0, f{x;p) is continuously differentiable and strictly convex in x G M"", and its 

gradient and Hessian are given as follows: 


V/(x; p) ='^ Ai(x; p)V fi{x; p), 


2=1 

m 


2=1 


v^/(x; m) = X] ( h) + hW fi{x; p)Vfi{x; /r)'^ 


- -V/(x;/i)V/(x;/i)'^ 


(3) 

(4) 


where 


Xi{x;p) 


V/*(x;^) 


'^‘^fiix-,p) 

gi{x;p) 


exp{fi{x;p)/p) 

m 

^exp(/j(x;^)//r) 

i=i 

X — Ci 

7 r; ^ 172,..., m, 

9i{x-,P) 

In {x - Ci){x - Ci)’^ 


G (0, 1), i 


9i{x;p) gi{x-,pY 

■\/\\x - CiP p^, i = 1,2,... ,m, 


, i = 1,2,...,m, 


and In denotes the n x n identity matrix. 


(5) 

( 6 ) 

(7) 

( 8 ) 
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(9) 


It can be easily seen from (§, ®, and Q that, for any ^ > 0, 

m 

^ = 1 , 

i=l 

||V/i(x;/x)|| <1, i = 1,2,... ,m. 
Combining Q, Q, and ( |10[ ), we further obtain 

l|V/(x;;a)|| <1. 


( 10 ) 


( 11 ) 


The algorithm proposed in pQ is based on the log-exponential aggregation function 0. We rewrite 
it as Algorithm in this paper as follows. 

Algorithm 1 

1: Let a G (0,1), ei, €2 >0, xq G M"", and /tq > 0 be given, and set A: = 0. 

2: repeat 

3: Use the limited-memory BFGS algorithm m to solve problem 

min/(x;/ifc), (12) 

and obtain Xk such that \\Vf{xk; Hk)\\ < £ 2 - 
4: Set fj-k+i = and A: = A: -|- 1. 

5: until Hk < ei 


Theorem 2.2 (IJ^) Let ei = 62 = 0 in Algorithm^ Suppose that {xk}k>i be the sequence generated 
by Algorithm^ and x* be the unique solution to problem Q. Then 

lim Xk = X*. 
k—^-\-oo 


In the next section, we shall exploit the special (approximate) sparsity property of the log-exponential 
aggregation function /(x; p) and propose an inexact Newton-CG algorithm for solving the smooth¬ 
ing approximation problem (12) and thus the SEB problem (Q. 


3 Inexact Newton-CG Algorithm 

As can be seen from (|^ and (Q, the gradient V/(x; p,) and Hessian V^/(x; p) of /(x; p) are (convex) 
combinations of Vfi{x; p) and V^/j(x; p) (i = 1, 2,..., m) with the vector 

X{x;p) = {Xi{x] p), X 2 {x; p),..., Xm{x] p))'^ 
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being the combination coefficients. As the parameter gets smaller, a large number of Ai(x; //) {i = 
1,2,, m) become close to zero and thus are neglectable. To see this clearly, we define 


Since 


and 


/oo(x;^) = max {/^(x;^)} . 
l<2<m 


1 < ^exp((/i(x;//) - foc,{x-,n)) lii) < m 
i=\ 


Aj(x;/x) = 




exp((/i(x;/r) - focix; fJ,)) /fJ.) 


i=i i=i 


it follows that 

exp((/i(x;/r) - /oo(x;/r))/^) 


m 


< Ai(x;/i) < exp((/i(x;/i) - focix] fi)) / fi), i = l,2,...,m. (13) 


The second inequality of (13) shows that if /i is sufficiently small or /i(x; fi) is much smaller than 
/oo(x; fi), then Aj(x; fj.) is approximately equal to zero, and fi{x\ fi) has little contribution to f{x; fj.) 
in ([^. 

Motivated by the above observation of the (approximate) sparsity of the vector A(x;/i), we pro¬ 
pose to compute V/(x; /r) and V^/(x; fi) in an inexact way by judiciously neglecting some terms 
associated with very small Aj(x; //). In such a way, the computational cost is significantly reduced 
(compared to compute V/(x; fi) and V^/(x; fj.) exactly). Then, we propose an inexact Newton-CG 
algorithm to solve the smoothing approximation problem (12). The search direction in the inex¬ 
act Newton-CG algorithm is computed by applying the CG method to solve the inexact Newton 
equation in an inexact fashion. 


3.1 An adaptive criterion and error analysis 


In this subsection, we give an adaptive criterion of inexactly computing the gradient/Hessian and 
analyze the errors between the inexact gradient/Hessian and the true ones. For any given 63 G 
(0,1], /i G (0,1], define 

S{x] fi,e) = {i\Xi{x;fj.) > e} (14) 


with 


10 m 


(15) 
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It is simple to see S{x]^,e) / 0. Otherwise, suppose S{x-,fi,e) = 0. Then it follows from (15) and 
the facts 63 < 1 and // < 1 that 


i=l i=l 

which contradicts (§. Hence, it makes sense to define 
/(x;/r) =//In I ^ exp (/i(x;//)///) 

\iGS{x;fj.,e) 

V/(x;//)= ^ Ai(x;//)V/i(x;//), 


V^/(x;//)= ^ ( Ai(x;/i)VV*(a:;//) +-Ai(x;//)V/i(x;//)V/i(x;//)^ 


i&S{x\ii,e) 

- -V/(x;//)V/(x;//)'^, 


where 


Aj(x;/i) = 


exp (/j(x;//)///) 

^ exp{fj{x-iJ:)/n) 


G (0, 1), / G 5(x;/i,e). 


According to (ii) of Lemma 2.1 we have 

/(x) < /(x; //) < /(x; //) < /(x) + // (1 + In m), 


(16) 

(17) 

(18) 


(19) 


where the second inequality holds with “=” if and only if S{x;fi,e) dehned in (14) equals the set 


{l,2,...,m}. Inequality (19) gives a nice explanation of /(x;/t) defined in ([1^. For any given 


/i G (0,1], (ii) of Lemma 2.1 shows /(x; //) is a uniform approximation to /(x), while /(x; //) could 
be explained as a “better” point-wise approximation to /(x) (compared to /(x;//)). 


The error estimations associated with (14) is given in the following theorem. 


Theorem 3.1 Given €3 G (0,1], // G (0,1], let e, 5(x;//,e), /(x;/i), V/(x;//), and f{x; fi) be 
defined as in (15), (14), (©, and ([Ts]), respectively. Then, there hold 


< /i^es/g, 

V/(x;/i) - V/(x;//) </ie 3 / 5 , 
VV(x;//) - V^/(x;//) < 4 e 3 / 5 . 


( 20 ) 

( 21 ) 

( 22 ) 
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Proof. We first prove (|20[) holds true. It follows from ([^ and (14) that 


Xi{x;^)<me, Aj(x;/r) > 1 — me. 

Recalling the definitions of f{x;^) and f{x]ix) (cf. (§ and ([Tg])), we obtain 


f{x-^i)-f{x;^) = ^In ( ^exp(/i(x;/i)//r) I -/iln ^ exp (/^(a;;/i)//i) 

Vi=l / \i&S{x;^,e) 

exp(/j(x;Ai)/Ai) ^ Ai(x;/e) 

(“i i^S{x;^,e) i^S(x\)jL,e) 


< Ai 


= 


^ exp(/i(x;/i)//i) ^ Ai(x;/r) 

i&S{x-,fi,E) i(iS{x\iJ,,e) 


< jJ -——— < (from (1^ and (fl^) 

1 _ Q ■ I ■ I 


1 — me 9 

where (a) comes from the fact that ln(l + x) < x for any x > 0. 


Now we prove (21) holds true. Since 


^ Xi{x;n)- ^ Xi{x;n) = l- ^ Ai(x;/i)= ^ Ai(x;^)>0, 


and 


Aj(x;/i) > Xi{x;n), V i £ S{x;^,€), 
it follows from ([^ and (© that 

V/(x;/r) - Vf{x;n) 

^ (Aj(x;/i) - Ai(x;/i)) V/i(x;/i) + ^ Xi{x; n)X7 fi{x-, fj.) 

ieSix■,^i,e) iiS{x■,^l,e) 

- ^J-) - Xi{x; \\Vfi{x; ^)\\ + ^ Ai(x;//) ||V/i(x; ^)|| 

< 2 Ai(x;/i) (from (10) and (24)) 

i^S{x;^i,E) 

< 2me = [le’ijh. (from (23) and ([I^) 




















Finally, we show (22) is also true. Combining @ and ( [T^ yields 

V2/(x;//) 


< 


^ ^ Xi{x-, fi{x; fj,) 


i=l 


Term A 


1 

H— 
fJ- 


Xi{x] n)Vfi{x; n)Vfi{x; n)'^ - ^ Xi{x-, fj.)Vfi{x] n)Vfi{x] nY 

iGS{x-,fi,e) 


i=l 


Term B 


H— 


V/(x; /u)V/(x; ^u)'^ - V/(x; /u)V/(x; /r)'" 


Term C 


Noticing that all eigenvalues of V^/i(x; /r) (cf. 0) are 


Pi — P2 — ‘ ‘ ‘ — Pn—1 — / \ ? Pn — 


it follows from (j^ that 


gi{x;n)' ” gi{x-,fiY' 


|V^/i(x;^)|| <-, i = 1,2,...,m. 


The same argument as in (25) shows 


Term A < 


2me 




Term B < 2me. 


Combining (dH), (Hi, and the fact ||v/(x;/r) 


< 1, we have 


Term C < 


V/(x; g) (Vf{x; g) - V/(x; g)^ + (^V/(x; g) - V/(x; g)^ V/(x; gY 


< l|V/(x;/i)|| Vf{x-,g)-Vf{x;g) + V f{x; g) - V f{x-, g) Vf{x]g) 


< 2 


V/(x;^) - Vf{x]g) 


< 4me. 


Now we can use (26), (27), and (28) to conclude 


V‘^f{x]g) -V^f{x]g) 


< 


Sme 4e3 
g 5 


( 26 ) 


(27) 


(28) 


This completes the proof of Theorem 3.1 


□ 
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3.2 Solving inexact Newton equation 


In the classical (line search) Newton-CG algorithm |41l I42j . the search direction is computed by 
applying the CG method to the Newton equation 

V2/(x;^)d = -V/(x;//), (29) 

until a direction d is found to satisfy 

\\V‘^f{x]ij)d + Vf{x]p)\\ < r?(x;/i) ||V/(x;/i)|| , 

where ??(x; /u) controls the solution accuracy. For instance, r/(x; /r) can be chosen to be 

min|o.5, v/||V/(x;/i)||| . 

A drawback of the classical Newton-GG algorithm when applied to solve the SEB problem with 
large m and n is that it is computationally expensive to obtain the Hessian and the Hessian-vector 
product. 


Fortunately, Theorem 3.1 shows that V"^/(x; p) and V/(x; /x) are good approximations to V"^/(x; p) 


and V/(x;/i), respectively. Therefore, it is reasonable to replace the (exact) Newton equation 
with the inexact Newton equation 

V^/(x;^)d = -V/(x;/x). 


(30) 


Using the similar idea as in the classical Newton-GG algorithm, we do not solve (30) exactly but 
attempt to find a direction d satisfying 


vV(x;/x)(i-h V/(x;/i) < fi{x-fi) V/(x;/x) 


where fj(x; fi) controls the solution accuracy. For instance, we can set f}{x; fi) to be 


(31) 


ff{x; fi) = min <0.5, J V/(x;/x) 


We apply the GG method to inexactly solve the linear equation (30) to obtain a search direction d 


satisfying (31). The reasons for choosing the GG method for solving (30) are as follows. First, the 
matrix V^/(x; fi) is positive definite, which can be shown in the same way as in (iii) of Lemma 


2.1 


and the GG method is one of the most useful techniques for solving linear systems with positive 
definite coefficient matrices |42j . Second, in the inner GG iteration, the Hessian-vector product 
V‘^f{x-,fi)d is only required but not the Hessian V^/(x;/x) itself. This property makes the GG 
method particularly amenable to solve the linear equation (pOl). Specifically, due to the special 
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structure of V^/(x;/i), the product V^/(x;^)(i can be obtained very fast for any given d. From 
(§, 0, (d!]), and simple calculations yield 




E 
E 


Ai(x;^) 
H gi{x]^)) gi{x;gY 


(x - Ci)(x - a)^ d 


+ 

i£S{x-,fi,e) 

E 


K{x,g) 

gAx^g.) g 


1 


1 


+ 


E 


Kix-,g) 
g gi{x;g)J gi{x;gy 

Xi{x;g) 


(X - Ci) 


{x - Ci)'^d 


(32) 


gi{x]g) 


d-V f{x]gY d 


X/fix;g) 

Ai 


The way of calculating V^/(x; g)d by (^^is typically different from the way of first calculating 
V‘^ f{x;g) and then calculating f{x; g)d. The complexity of computing f{x; g)d using the 
above two ways are 0{\S{x] g, e)\n) and O ((|5(x; e)| + n)n^) , respectively. It is worthwhile 

remarking that the computational complexity of calculating V^/(x; g)d using the above mentioned 
two ways of are 0{mn) and O ((m + n)n^) , respectively. Notice that \S{x]g,e)\ is usually much 
less than m. Hence, computing V^/(x; g)d by (32) can sharply reduce the computational cost and 
simultaneously save a lot of memory (since we do not need to store the n x n matrix V^/(x; g)). 


Let df be the obtained direction satisfying (31) by applying the CG method to solve the linear 


equation (30) with the starting point do = 0. In the sequential, we state two properties of the 


direction df. These two properties shall be used late in global convergence analysis of the proposed 
algorithm. 


Lemma 3.2 Consider applying the CG method to solve (30) with the starting point do = 0. Suppose 


Vf{x-,g) Y 0 df is the obtained search direction satisfying (31). Then 

df^f{x;g) = -(FfV‘^f{x;g)df < 0. 


(33) 


Proof. Since the starting point do = 0, the final point d/ in the CG iteration must have the form 
df = Eto ^jPj SD 02] > where and are step sizes and search directions in the 


CG iteration. Notice that Vf{x-,g) Y Oj then df / Q. Otherwise, substituting df = 0 into (31), we 
shall get 


Vf{x;g) <fj{x-,g) Vf{x]g) 


< 0.5 


V/(x;/x) 


^The terms in square brackets in (321 are constants in the inner CG iteration, since they are not related to the 
variable d. 
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which contradicts the fact V f{x; fi) / 0. Let 

Vf = ^J)df + V/(x; ^J). 

Then, it follows from HD Theorem 5.2] that 

= 0, j = 0,1,1. 

Hence, 


(34) 


(35) 


<ijv/(x;^) = d’f [ff-V‘^f{x]^i)dfj (from @) 

= (Ffff - dfV‘^f{x;n)df 

/-I /-I 

= dijpjff — (ijv^/(x; fj,)df (substituting df = ^jPj) 
j=0 j=0 

= — f{x-, fi)df (from (35)) 

< 0 , 

where the last inequality is due to positive definiteness of V^/(x; ^) and the fact df ^ 0. The proof 
is completed. □ 


Lemma 3.3 Suppose d satisfies (31), and crmax(a^;/^) and dniinix] fj,) > 0 are the maximum and 
minimum eigenvalues o/V^/(x;/r), respectively. Then 


1 - i?(x;/x) 

d'max(^5 T) 


V/(x;/x) 


< 


< 


l + fj{x;n) 
d'min(3^) h) 


V/(x;^) 


Proof. Suppose the second inequality in (|36|) does not hold true, i.e., 

V/(x;/i) 


> 


1 + r)(x;/i) 


d'min(3^) /^) 


Then 


V‘^f{x-,n)d + Vf{x;n) > V‘^f{x-,n)d - Vf{x;p.) 


> dmin(a:;^) 


V/(x;^) 


> i'i-+ d [x] fi)) Vf{x;fj.) - Vf{x;fj.) 
= d{x]p) Vf{x]ia) 


which contradicts (31). Hence, the second inequality in (36) holds true. 


(36) 


The similar argument shows the first inequality in (36) is also true. The proof is completed. □ 
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3.3 Inexact Newton-CG algorithm 


When the smoothing parameter jjL approaches zero, exp {fi{x] fi)/fi) tends to be very large. The 
special care should be taken in computing /(x; /j.) and Xi{x; fi) to prevent overflow [26], i.e.. 


= foo{x-,n) + filni ^exp((/i(x;^) - /oo(x;/i)) ///) , 


(37) 


, 2=1 


w.„.,.N_ exp((/i(x;/i) -/oo(x;^))/^) ioo\ 

/i) M { \ -Ft S\X^ /i, 6). (38) 

z2jGSix-,i,,e) exp((/j(x; fi) - /oo(x; ^)) >) 

Based on the above discussions, the specification of the proposed inexact Newton-CG algorithm 
for solving the SEB problem is given as follows. 

Algorithm 2 

1: Let ei. Cl G (0,1), P G (0,1), {fik, e 2 (Mfc), e 3 (A‘fe)}fc , a^o,o £ IR” be given and set k = j = 0. 

2: repeat 
3: repeat 

4: Compute S{xkj', P'k-, according to (14). 

5: Compute the search direction dkj by applying the CG method to the inexact Newton 

equation V‘^f{xkj; kik)d = —Vf{xkj; pik) such that 


^ f (.X}^j, T ^ Vk,j ^ f {.XkJ) k'k) 


where 


= min 0.5, W Vf{xkj-, fJ-k) 


(39) 

(40) 


6 : 


the Hessian-vector product f{xkj', tJ-k)d in the inner CG iteration, Vf{xkj] fkk), and 
^i{xk,j] k-k) are computed by ([T7f> and ( pSj ), respectively. 

Set Xkj+i = Xkj + akjdkj, where akj = /3^ with /3 G (0,1) and I being the smallest 
integer satisfying the sufficient decrease condition 


f{xk,j + P dk^j'ixk) < fixkj-,kk) + ci/3^dl jVf{xkj-,kk), 


(41) 


7: 


where /{xkj; kk) is computed by (37) 
Set j =j + 1. 


8 : until S/f{xk,j]kk) <^2{kk) 

9: Set Xfc+i^o = Xk^j and /c = A: -|- 1. 

10 : until p,k < ei 


The actual parameter values used for ei, ci, (3, {/Ufc, e 2 {kk), e 3 (^A:)} hr Algorithm[^shall be given 
in Section As we can see, all parameters in Algorithm are updated adaptively. For instance. 
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the final iterate is set to be a warm starting point for the problem mina^gKn /(x; fJ-k+i), and the 
tolerance e 2 (/ifc) is set to be related to the approximation parameter /ifc. 


It is worthwhile pointing out that if we set es{fj,k) to be zero in line of the proposed Algorithm 
2, then the proposed algorithm reduces to apply the classical Newton-CG algorithm to solve the 
smoothing approximation problem (12). Hence, the sequences generated by the proposed Algorithm 
[^converge to the unique solution of problem Q according to [U Theorem 3]. In the next section, 
we shall show that even though the parameters are positive, i.e., the gradient and Hessian- 

vector product are inexactly computed to reduce the computational cost, the proposed inexact 
Newton-CG Algorithm 2 is still globally convergent. 


4 Convergence Analysis 


In this section, we establish global convergence of the proposed Algorithm with an appropriate 


choice of parameters. For any /U > 0, since /(x; is strictly convex (see Lemma 2.1) and coercive 
in X, the level set 

H(//) = {x|/(x;//) </(xo,o;/io)} (42) 

must be convex and bounded, where xo,o is the initial point in Algorithm Furthermore, since 
the set {1,2,..., m} has a finite number of subsets, then there must exist (Tmax(Ai) > o'min(/.i) > 0 
such that, for V^/(x; /r) defined on any proper subset of (1,2,..., m} , we have 

<7max(/^).^n ^ ^ — Crmin(/^)4n, V X G H(/i). (43) 

As a particular case, we have 

^max ^ V X G H(/J.). 

Before establishing global convergence of the proposed Algorithm we first show that it is well 
defined. In particular, we prove that the proposed algorithm can always find a step length akj = 13^ 

V/(xfejj^;^fc) <€2{nk) 


satisfying (41) in finite steps (see Lemma 


(see Lemma 4.2). 


4.1) and there exists jk such that 


Lemma 4.1 Suppose 


V/(xfcj;/rfc) > e 2 {nk), and set 

62 (life) 


where 


f-zihk) < 

C 2 {hk) > 


C2{hk) ’ 
6/^A:6’'inax(h'A:) 


5(1 - Cl)<in(l^fc) 


(44) 

(45) 
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Then the step length akj satisfying the sufficient decrease condition (41) can he found in 
steps, and 

ak,j > faink), V j, 

where 

-/ \ ~ _min {hk) Q 

^ 9^max(^fc) 15cJmax(^fc)c2(Atfc) 

Proof. By the mean value theorem, there exists s G (0,1) such that 

f{xk,j + oidk,fhk) - f{xk,fhk) - ciad^jVf{xkj;ikk) 


ln(a(/jfc)) 

ln(/3) 

(46) 

(47) 


= a 


^,j {yf{xk,Thk) - V f {xk,j] p.k)) +(1 - ci)ad[jVf{xk,j;fJ,k) 


Term A 


Term B 


(48) 


4“ 2 dkj^ f (xk,j 4“ Oisdk^j, t^k \ dkj 


Term C 

Next, we upper bound Term A, Term B, and Term C in the above, respectively. It follows from 


(21) and (44) that 


Furthermore, since 


there holds 


V/(x;/rfc) - V/(x;^fc) 


^ hkesihk) ^ hke2{hk) 
~ 5 ~ 5c2{nk) 


Vf{xk,j;tLk) > e. 2 {hk), 


(49) 

(50) 


V/(xfcj;/ifc) - V/(xfcj;/iA:) 


< 


hk 


^hxk,fhk) 

we have 


-^bc 2 {pik) 

Combining the above inequality, the second inequality of ( |3^ , and 

djj (vf{xk,j] Hk) - Vf{xkTTk)^ < dk,j ^f{xk,Thk) - '^f{xk,j]hk) 




10C2(^fc) ^ min ihk) 


^f{Xk,fhk) 


From the first inequality of ( |36[ ), ( |33| ), ( |40[ ) and ( |43| ), we obtain 

dljVf{xk,j]tik) = - dfcjV^/(xfcj;|Ufc)4j (from (|^) 


(51) 


(52) 


^ (^minihk) 
^minihk) 


dk,j 


(from (43)) 


< 


Vf{xk,j-,fJ-k) . (from (36) and (40)) 


The similar argument as in (52) shows that Term C in ( |48| ) can be upper bounded by 

9(Tmax(l^fc) 


+ asdkj; iik)dk,j < 


4^mm(/^fc) 


V/(xfcj;^fc) 


(53) 
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By combining (48), (51), (52), and (53), we obtain 


< a 


fi^kj 4 “ j)/^fc) jV/(x/jj,/i/j) 

2 / 3nk 


V/(xfcj;/Xfc) 


(1 Ci)<Tijjin(///j) 9<7max(/^A:) \ 

LLL' I 1 -—- p (y. - I 

\WC2{Hk)crmm{fJ-k) 8cJ^i^(/Xfc) / ' 


Consequently, it follows from (47) that, for any I such that /3* < a{^k)^ ^ satisfies the inequality 
(41), and the inequality (46) holds true. This completes the proof of Lemma 4.1, □ 


Lemma 4.2 Suppose pL = p,k and {xfcj} he the sequence generated by Algorithm^ Then there 
must exist jk such that 

'^fixkjAhk) <e 2 {tik)- (54) 


Proof. We prove Lemma [T2| by contradiction, i.e., suppose 

^f{xk,j]hk) > e 2 {tik), V j = 1,2,.... 
Since f{x,pLk) is lower bounded (by zero), it follows that 


+ 00 


+ 00 


Too > ^ {f{xk,j-,iak) - fixk,j+T,Tk)) = ^ [f{xk,j;Tk) - f{xk,j + akjdkj; Hk)) ■ 

j=0 j=0 


Moreover, since 


+ 00 

“t“00 > ^ ^ j? M/c) “1“ ^k^jdk^j 11J^k) 

3=0 

+ O0 

> ^ (from ([4T|)) 

i=o 

+ O0 

> ^ (^cif3a{nk)^jV'^ f{xk,j; p.k)dk,j^ (from ([^ and (|4^) 
j=0 

+00 

> ci 3 a{fik) ^min iTk)''^\\dk,j\\ , 

j=0 


it follows that lim ||dfc jll =0. Taking limits from both sides of (39), we obtain 

j—>+oo ’ - 


lim 

j—^+oo 


^f{xk,j;hk) 


= 0 , 


which contradicts (55). Hence, Lemma 4.2 is true 


(55) 


□ 


Now, we are ready to present the global convergence result of Algorithmic 
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Theorem 4.3 Let ei = 0, ^ 2 {t‘-k) = 0, and e^{iJLk) satisfies pi] ) for all k in Algorithm^^ 

Suppose that he the sequences generated by Algorithm^satisfying ( [^ and x* be the unique 

solution to problem 0 . Then 

lim Xk,j^ = X*. 
k^oo 


Proof. Recalling the definition of n(/i) (cf. (42)), it follows from part 2 of Lemma 2.1 that 

Ll{^k) c n := {x I f{x) < f{xo,o',ho)} , V A: > 0. 


Since f{x) is coercive, we know that Ll is bounded. From part 1 of Lemma 2.1 and (41), we have 

f{Xk ,jA Tk) — f (xk+lfl', t^k) > f (xfc+i^oi hk+l) ^ /(3^fc+l,l j hk+l) ^ ' ' ' ^ /(^fc+1 Jfc+i) hk+l)- 

Hence, the function values {f{xkj^', fJ^k)} are decreasing, and the sequences {xkj^.} lie in the bounded 
set H. Then there must exist an accumulation point for {x^jj,}. Let x denote an accumulation 
point such that 

X = lim Xfc 1 , 
k&K,k^oo 

for some subsequence indexed by JC. Since {f{xk,jk'^hk)} are decreasing and bounded below (by 
zero), it follows that lim /(x^j^,;/ifc) =/(x). 


Next, we show that \\Vf{xkjf.] p-k)\\ 0- la fact, it follows from (45), (49) and (54) that we have 

l|V/(xfcj-^fc)|| < ||V/(xfcj-^fc) -\/f{xk,ji^-,iik)\\ + ||V/(xfcj-Aifc)|| < 2e2(^fc). (56) 

Letting k go to infinity, we obtain the desired result WVf{xkj^; fJ-k)\\ 0. According to [U Lemma 

2, Theorem 3], we know x = x*. This completes the proof of Theorem 4.3 □ 


5 Numerical Results 


In this section, the proposed inexact Newton-CG algorithm (Algorithm was implemented and 
the numerical experiments were done on a personal computer with Intel Core i7-4790K CPU (4.00 
GHz) and 16GB of memory. We implemented our codes in C language and compared it with the 
state-of-the-art Algorithm 1 [T] and the classical Newton-CG algorithm. The test problems are 
generated randomly. Similar to [I], we use the following pseudo-random sequences: 

fio = 7, fii+i = (445V'j + 1) mod 4096, fii = '0i/4O.96, i = 1, 2,... 

The elements of r* and Cj, f = 1, 2,..., m, are successively set to '02,.. •, in the order: 

ri,ci(l),ci(2),... ,ci(n),r2,C2(l),C2(2),... ,C 2 (n),..., Cm(l), Cm(2),... ,Cm(n). 


17 










Table 1: Performance comparison of proposed Algorithmic classical Newton-CG algorithm, and 


Algorithm [T| in [T] with different large m and n = 1000/2000. 


Problem 

Proposed Algorithm 


Classical Newton-CG Algorithm 

Algorithm ; 

m 

(m, n) 

Time Obj Value 

Time Obj value 

Time Obj value 


(10000,1000) 

6.01552E+00 

1.022846334SE-h03 

6.00472E+01 

1.0228463348E+03 

5.90720E+01 

1.0228463348E-h03 

(20000,1000) 

1.10170E-h01 

1.0228463347E-h03 

1.16408E+02 

1.0228463347E+03 

1.08360E+02 

1.0228463347E-h03 

(30000,1000) 

1.92800E+01 

1.0228463347E-h03 

1.70676E+02 

1.0228463347e+03 

1.59982E+02 

1.0228463347E-h03 

(40000,1000) 

2.35979E+01 

1.0228463346E-h03 

2.49327E+02 

1.0228463346e-h03 

2.14136E-h02 

1.0228463346E-h03 

(50000,1000) 

3.02345E+01 

1.0228463347E-h03 

2.92019E+02 

1.0228463347e+03 

2.88675E+02 

1.0228463347E-h03 

(100000,1000) 

5.61113E-h01 

1.0228463347E-h03 

5.58410E+02 

1.0228463347e+03 

5.86357E+02 

1.0228463347E-h03 

(10000,2000) 

1.52080E+01 

1.3984577651E+03 

1.63971E+02 

1.3984577651E+03 

1.46725E-h02 

1.3984577651E+03 

(20000,2000) 

3.04284E-h01 

1.3984577651E+03 

3.35675E+02 

1.3984577651E+03 

2.43072E-h02 

1.3984577651E+03 

(30000,2000) 

4.53796E+01 

1.3984577649E+03 

4.41727E+02 

1.3984577649E+03 

4.17976E+02 

1.3984577649E+03 

(40000,2000) 

5.89272E+01 

1.3984577650E+03 

5.84628E+02 

1.3984577650E+03 

5.57352E+02 

1.3984577650E+03 

(50000,2000) 

7.38869E+01 

1.3984577650E+03 

7.32414E+02 

1.3984577650E+03 

7.18307E+02 

1.3984577650E+03 

(100000,2000) 

1.45665E+02 

1.3984577650E+03 

1.68460E+03 

1.3984577650E+03 

1.32608E+03 

1.3984577650E+03 


Different scales of the SEB problem are tested and the parameters used in Algorithm [C are set to 
be 

ei = IE — 6, Cl = IE — 4, j3 = 0.5, xo,o = 0) 

fik = (0.1)^ , e 2 (/UA:) = maxjlE - 5,min{lE - l;/rfc/10}} , e 3 (/ifc) = IE - 2, k = 0,1,...,6. 

The simulation results are summarized in Table [C Table [C and Table |C where n denotes the 
dimension of the Euclidean space, m denotes the number of balls, Obj Value denotes the value of 
the objective function in Q at the final iterate, and Time denotes the CPU time in seconds for 
solving the corresponding SEB problem. 

It can be seen from the three tables that the proposed Algorithm [C significantly outperforms 
Algorithm in [1] and the classical Newton-CG algorithm in terms of the CPU time to find the 
same solution. In particular, Algorithm and the classical Newton-CG algorithm take 8 and 10 
times more CPU time than proposed Algorithmic in average to find the same solution, respectively. 
The proposed algorithm is able to solve the SEB problem with m = 2048000 and n = 100 within 
about 90 seconds, while the classical Newton-CG algorithm and Algorithm 1 in [T] need 674 and 956 
seconds to do so, respectively. The proposed inexact Newton-CG algorithm significantly improves 
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Table 2: Performance comparison of proposed Algorithm]^ Algorithm[^in [T], and classical Newton- 


CG algorithm with different large/ 

huge m and n = 100. 

Problem Proposed Algorithm 

Classical Newton-CG Algorithm Algorithm ; 

m 


(m, n) Time Obj Value Time Obj value Time Obj value 


(16000,100) 

5.92168E-01 

4.0409180661E+02 

5.07334E+00 

4.0409180661E+02 

7.54851E+00 

4.0409180661E+02 

(32000,100) 

1.27262E+00 

4.0409180660E+02 

1.09639E+01 

4.0409180660E+02 

1.30855E+01 

4.0409180660E+02 

(64000,100) 

2.49998E+00 

4.0409180660E+02 

2.03190E+01 

4.0409180660E+02 

2.87963E+01 

4.0409180660E+02 

(128000,100) 

4.75222E+00 

4.0409180660E+02 

4.17729E+01 

4.0409180660E+02 

5.39767E+01 

4.0409180660E+02 

(256000,100) 

1.05534E+01 

4.0409180662E+02 

9.10787E+01 

4.0409180662E+02 

1.12828E+02 

4.0409180662E+02 

(512000,100) 

2.14911E+01 

4.0409180662E+02 

1.76339E+02 

4.0409180662E+02 

2.10324E+02 

4.0409180662E+02 

(1024000,100) 

4.51870E+01 

4.0409180662E+02 

3.38687E+02 

4.0409180662E+02 

4.28966E+02 

4.0409180662E+02 

(2048000,100) 

9.00532E+01 

4.0409180662E+02 

6.74268E+02 

4.0409180662E+02 

9.56397E+02 

4.0409180662E+02 


Table 3: Performance comparison of proposed Algorithm]^ Algorithm[^in [T], and classical Newton- 
CG algorithm with different large m and different large n. 


Problem 

Proposed Algorithm 

2 

Classical Newton-CG Algorithm 

Algorithm ; 

m 

(m, n) 

Time Obj Value 

Time Obj value 

Time Obj value 


(2000,5000) 

1.62869E+01 

2.1340381607E+03 

1.04678E+02 

2.1340381607E+03 

6.79232E-h01 

2.1340381608E+03 

(2000,10000) 

4.07598E+01 

2.9778347203E+03 

2.43027E-b02 

2.9778347203E+03 

1.41727E-h02 

2.9778347203E+03 

(5000,5000) 

3.21717E-h01 

2.1377978300E+03 

3.34972E-b02 

2.1377978300E+03 

1.60278E-h02 

2.1377978300E+03 

(5000,10000) 

1.18895E+02 

2.9814491291E-h03 

9.20224E+02 

2.9814491291E-b03 

3.69496E+02 

2.9814491291E-h03 

(8000,7000) 

1.56516E+02 

2.5108384309E+03 

1.50597E+03 

2.5108384309E+03 

4.17278E-h02 

2.5108384309E+03 

(100000,8000) 

1.54017E-h02 

2.6749515342E+03 

1.24485E-b03 

2.6749515342E+03 

5.43961E+02 

2.6749515342E+03 

(100000,10000) 

2.16453E-h02 

2.9814491291E-h03 

1.66959E+03 

2.9814491291E-b03 

8.13515E+02 

2.9814491291E-h03 

(200000,10000) 

4.13139E-h02 

2.9814491290E-h03 

3.04470E+03 

2.9814491290E-b03 

1.59488E+03 

2.9814491290E-h03 
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the classical Newton-CG algorithm by computing the gradient and Hessian-vector product in an 
inexact fashion, which dramatically reduces the CPU time compared to the exact computations. 

We also plot the CPU time comparison of proposed Algorithm Algorithm in [1] , and classical 
Newton-CG algorithm with different large m and fixed n = 2000 as Fig. It can be observed from 
Fig. [^that for fixed n = 2000, the CPU time of all of three algorithms grow (approximately) linearly 
with m. However, the CPU time of both Algorithmand the classical Newton-CG algorithm grows 
much faster than that of proposed Algorithmic 

In a nutshell, our numerical simulation results show that the proposed inexact Newton-CG algo¬ 
rithm is particularly amenable to solve the SEB problem of large dimensions. First, the gradient 
and Hessian-vector product are inexactly computed at each iteration of the proposed algorithm by 
exploiting the (approximate) sparsity structure of the log-exponential aggregation function. This 
dramatically reduces the computational cost compared to compute the gradient and Hessian-vector 
product exactly and thus makes the proposed algorithm well suited to solve the SEB problem with 
large m. Second, at each iteration, the proposed algorithm computes the search direction by ap¬ 
plying the CG method to solve the inexact Newton equation in an inexact fashion. This makes the 
proposed algorithm also very attractive to solving the SEB problem with large n. 


6 Conclusions 

In this paper, we developed a computationally efficient inexact Newton-GG algorithm for the SEB 
problem of large dimensions, which finds wide applications in pattern recognition, machine learning, 
support vector machines and so on. The key difference between the proposed inexact Newton-GG 
algorithm and the classical Newton-GG algorithm is that the gradient and the Hessian-vector 
product are inexactly computed in the proposed algorithm by exploiting the special (approximate) 
sparsity structure of its log-exponential aggregation function. We proposed an adaptive criterion of 
inexactly computing the gradient/Hessian and also established global convergence of the proposed 
algorithm. Simulation results show that the proposed algorithm significantly outperforms the clas¬ 
sical Newton-GG algorithm and the state-of-the-art algorithm in [T] in terms of the computational 
CPU time. Although we focused on the SEB problem in this paper, the proposed algorithm can 
be applied to solve other min-max problems in [HI 051 HU 071 08l 09] . 
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Figure 1: Time comparison of proposed Algorithm]^ Algorithmin [T], and classical Newton-CG 
algorithm with different large m and fixed n = 2000. 


21 













































ence, Chinese Academy of Sciences, for their helpful comments on the paper. The authors also 
thank Professor Guanglu Zhou of Department of Mathematics and Statistics, Curtin University, 
for sharing the code of Algorithm in [T] . 


References 

[1] Zhou G., Toh K.C., Sun J.: Efficient algorithms for the smallest enclosing ball problem. Comput. 
Optim. k Appl. 30, 147-160 (2005) 

[2] ReVelle C.S., Eiselt H.A.: Location analysis: A synthesis and survey. European J. Oper. Res. 
165, 1-19 (2005) 

[3] Burges C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. 
Disc. 2, 121-167 (1998) 

[4] Nielsen E., Nock R.: Approximating smallest enclosing balls with applications to machine 
learning. Int. J. Comput. Geom. k Appl. 19, 389-414 (2009) 

[5] Chung F.L., Deng Z., Wang S.: From minimum enclosing ball to fast fuzzy inference system 
training on large datasets. IEEE Trans. Fuzzy Sys. 17, 173-184 (2009) 

[6] Chapelle O., Vapnik V., Bousquet O., Mukherjee S.: Choosing multiple parameters for support 
vector machines. Mach. Learn. 46, 131-159 (2002) 

[7] Ben-Hur A., Horn D., Siegelmann H.T., Vapnik, V.: Support vector clustering. J. Mach. Learn. 
Res. 2, 125-137 (2001) 

[8] Cervantes J., Li X., Yu W., Li K.: Support vector machine classification for large data sets via 
minimum enclosing ball clustering. Neurocomput. 71, 611-619 (2008) 

[9] Badoiu M., Har-Peled S., Indyk P.: Approximate clustering via core-sets. Proceedings of the 
34th Annual ACM Symposium on Theory of Computing, 250-257 (2002) 

[10] Alon N., Dar S., Parnas M., Ron D.: Testing of clustering. SIAM Review 46, 285-308 (2004) 

[11] Deng Z., Chung F.L., Wang S.: FRSDE: Fast reduced set density estimator using minimal 
enclosing ball approximation. Pattern Recognition 41, 1363-1372 (2008) 

[12] Elzinga D.J., Hearn D.W.: The minimum covering sphere problem. Manage. Sci. 19, 96-104 
(1972) 

[13] Hearn D.W., Vijan J.: Efficient algorithms for the (weighted) minimum circle problem. Oper. 
Res. 30, 777-795 (1982) 


22 


[14] Xu S., Freund R.M., Sun J.: Solution methodologies for the smallest enclosing circle problem. 
Comput. Optim. & Appl. 25, 283-292 (2003) 

[15] Megiddo N.: Linear-time algorithms for linear programming in and related problems. SIAM 
J. Comput. 12, 759-776 (1983) 

[16] Preparata F.P., Shamos M.I.: Computational Geometry: An Introduction, Texts and Mono¬ 
graphs in Computer Science. Springer-Verlag, New York (1985) 

[17] Shamos M.I., Hoey D.: Closest-point problems. Proceeding of the 16th Annual Symposium on 
Foundations of Computer Science, 151-162 (1975) 

[18] Dyer M.; A class of convex programs with applications to computational geometry. Proceedings 
of the 8th Annual Symposium on Computational Geometry, 9-15 (1992) 

[19] Welzl E.; Smallest enclosing disks (balls and ellipsoids). Lecture Notes in Computer Science 
555, 359-370 (1991) 

[20] Gartner B., Schonherr S.; An efficient, exact, and generic quadratic programming solver for ge¬ 
ometric optimization. Proceedings of the 16th Annual Symposium on Computational Geometry, 
110-118 (2000) 

[21] Fischer K., Gartner B.: The smallest enclosing ball of balls; combinatorial structure and 
algorithms. Int. J. Gomput. Geometry & Appl. 14, 341-378 (2004) 

[22] Gheng D., Hu X., Martin C.: On the smallest enclosing balls. Gommun. Inf. & Sys. 6, 137-160 
(2006) 

[23] Boyd S., Mutapcic A.: Subgradient methods. Notes for EE364b, Standford University (Winter 
2006-07) 

[24] Shor N.Z.: Minimization Methods for Non-Differentiable Eunctions. Springer-Verlag, New York 
(1985) 

[25] TiiTiincii R.H., Toh K.C., Todd M.J.; Solving semidefinite-quadratic-linear programs using 
SDPT3. Math. Prog. Ser. B. 95, 189-217 (2003) 

[26] Xu S.: Smoothing method for minimax problems. Gomput. Optim. &: Appl. 20, 267-279 (2001) 

[27] Pan S.H., Li X.S.: An efficient algorithm for the smallest enclosing ball problem in high 
dimensions. Appl. Math. &: Comput. 172, 49-61 (2006) 

[28] Nesterov Y.: Smooth minimization of non-smooth functions. Math. Prog., Ser. A. 103, 127- 
152 (2005) 


23 



[29] Xiao Y., Yu B.: A truncated aggeregate smoothing Newton method for minimax problems. 
Appl. Math. & Comput. 216, 1868-1879 (2010) 

[30] Polak E., Royset J.O., Womersley R.S.; Algorithms with adaptive smoothing for finite minimax 
problems. J. Optim. Theory & Appl. 119, 459-484 (2003) 

[31] Polak E.: Optimization: Algorithms and Consistent Approximations. Springer-Verlag, New 
York (1997) 

[32] Zang I.; A smoothing-out technique for min-max optimization. Math. Prog. 19, 61-77 (1980) 

[33] Li J., Wu Z., Long Q.: A new objective penalty function approach for solving constrained 
minimax problems. J. Oper. Res. Soc. China 2, 93-108 (2014) 

[34] Lii Y.B., Wan Z.P.: A smoothing method for solving bilevel multiobjective programming 
problems. J. Oper. Res. Soc. China 2, 511-525 (2014) 

[35] Li X.S.; An aggregate function method for nonlinear programming. Sci. China Ser. A. 34, 
1467-1473 (1991) 

[36] Li X.S., Pang S.C.; On the entropic regularization method for solving min-max problems with 
applications. Math. Methods Oper. Res. 46, 119-130 (1997) 

[37] Liu D.C., Nocedal J.: On the limited memory BEGS method for large scale optimization. 
Math. Prog. 45, 503-528 (1989) 

[38] Chen B., Barker P.T.: A non-interior-point continuation method for linear complementarity 
problems. SIAM J. Matrix Anal. & Appl. 14, 1168-1190 (1993) 

[39] Kanzow C.: Some noninterior continuation methods for linear complementarity problems. 
SIAM J. Matrix Anal. & Appl. 17, 851-868 (1996) 

[40] Smale S.: Algorithms for solving equations. Proceedings of International Congress of Mathe¬ 
maticians (1987) 

[41] Nocedal J., Wright S.J.: Numerical Optimization. Springer-Verlag, New York (1999) 

[42] Sun W., Yuan Y.X.; Optimization Theory and Methods: Nonlinear Programming. Springer 
Science-|-Business Media (2006) 

[43] Larsson T., Kalberg L.: East and robust approximation of smallest enclosing balls in arbitrary 
dimensions. Eurographics Symposium on Geometry Processing 32, 93-101 (2013) 

[44] Arkin E.M., Hassin R., Levin A.: Approximations for minimum and min-max vehicle routing 
problems. J. Algorithm 59, 1-18 (2006) 


24 



[45] Cherkaev E., Cherkaev A.: Minimax optimization problem of structural design. Comput. & 
Struct. 86,1426-1435 (2008) 

[46] Al-Subaihi I., Watson G.A.: Fitting parametric curves and surfaces by loo discrete regression. 
BIT Numer. Math. 45, 443-461 (2005) 

[47] Liu Y.F., Dai Y.H., Luo Z.Q.: Coordinated beamforming for MISO interference channel: 
Complexity analysis and efficient algorithms. IEEE Trans. Signal Process. 59, 1142-1157 (2011) 

[48] Liu Y.F., Hong M., Dai Y.H.; Max-min fairness linear transceiver design problem for a multi¬ 
user SIMO interference channel is polynomial time solvable. IEEE Signal Process. Lett. 20, 
27-30 (2013) 

[49] Liu Y.F., Dai Y.H., Luo Z.Q.: Max-min fairness linear transceiver design for a multi-user 
MIMO interference channel. IEEE Trans. Signal Process. 61, 2413-1423 (2013) 


25 



